This paper proposes using hand-drawn sketches as goal representations for robotic manipulation policies. Sketches provide a middle ground between natural language, which can be ambiguous, and goal images, which can be over-specified. The authors present RT-Sketch, a policy that takes a sketch of a desired scene as input and outputs robotic actions to rearrange objects t...